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(54) Evaluation of programming statements 



(57) A statement evaluation technique is based on 
bi-evaluation of programming statements. A program- 
ming language statement Is evaluated that Includes a 
first and a second sub-statement. The first sub-state- 
ment is evaluated and an evaluation success result is 
determined if evaluation succeeds, or a distinguished 
value if evaluation fails. The distinguished value is a val- 
ue that is not included In the range of possible evaluation 
success results of the first sub-statement. Further it is 



determined whether the second sub-statement is to be 
evaluated. If this is the case, an evaluation success re- 
sult of the second sub-statement is determined if eval- 
uation succeeds, or the distinguished value if evaluation 
falls. The range of possible evaluation success results 
of the second sub-statement does not include the dis- 
tinguished value. The evaluation result of the statement 
Is detennined depending on at least whether evaluation 
of the first sub-statement succeeds or fails. 
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Description 

[0001] The invention generally relates to the evaluation of programming language statements and in particular to a 
method and system for evaluating a programming language statement that includes a first and a second sub-statement. 

5 [0002] Presently, several techniques have been developed for evaluating programming language statements. Dis- 
coveries and the progress in the area of programming language theories and methods are fundamental. They have 
first a long term deep impact on other research areas, in particular computational semantics, type systems and pro- 
gramming models^ and they strongly improve software development processes both in time and quality. As an example, 
the object oriented paradigm and its application is probably the most fertile advance of the last two decades, pervading 

10 software production and design. 

[0003] The separation of declarative languages versus imperative languages is commonly accepted as two different 
ways of solving computational related problems. With declarative languages, a programmer expresses whattVie solu- 
tion is, while the imperative languages require the definition of /^ow^the solution is reached by specifying intennediate 
computation steps. 

15 [0004] Declarative languages are preferred when the application field Is well defined and restricted, because they 
are simple and often rely on efficient algorithms, such as Prolog and Herbrand resolution, constraint solving system 

algorithms and the simplex algorithm. On the other hand, imperative languages are useful for solving general problems, 
and allow the mastering of execution time. However, Imperative languages have a higher cost of providing a much 
more important amount of specification, and produce a complexity overload, 

20 [0005] There are today areas where programmers would need to combine both advantages of these two poles in a 
flexible and easy way, The operations for transforming structured data, such as XML documents, typically range from 
simple operations to very complex ones, involving different levels of abstraction. In such cases, programmers would 
prefer a common framework that enables the use of concise and declarative notations as long as this is possible, while 
reserving low level, fine grain imperative specifications to difficult cases. 

25 [0006] For such a framework, language theorists and designers are still looking for expressive, powerful, simple, 
clear and precise formalisms in order to capture the most fundamental operations. However, considering both semantics 
and typing, general solutions at the right abstraction level have not been proposed yet. 

[0007] Given the problems of the existing technologies, it would therefore be advantageous to provide a method and 
system for evaluating a programming language statement capable of dealing with arbitrary structural complexity while 
30 preserving relevant type control and keeping the amount of basic building blocks reasonably small. 

[0008] It would further be advantageous to provide an evaluation technique where the assumptions made on the 
underlying language are explicit and restricted so that It can be embedded into existing or future, more specialized or 
general purpose programming languages. 

[0009] Further, it would be advantageous to provide an evaluation method and system with fomnal syntax typing and 
35 semantics on an unambiguous basis and an extensible theoretic framework Independently from notations. Moreover, 

it would be advantageous to provide such an evaluation technique that enables the combination of declarative and 
imperative operations. 

[0010] The present Invention has been made in consideration of the above situation and provides a method, and 
article of manufacture therefor, for operating a computer system for evaluating a programming language statement 
40 that includes a first and a second sub-statement. The first sub-statement Is evaluated and an evaluation success result 

is determined if the evaluation succeeds, If the evaluation fails, a distinguished value is determined that is a value not 
included in the range of possible evaluation success results of the first sub-statement. Further, it is detennined whether 
the second sub-statement Is to be evaluated and if so, the second sub-statement Is evaluated and an evaluation 
success result is detemnlned if the evaluation succeeds. If the evaluation falls, the distinguished value Is determined. 
45 The range of possible evaluation success results of the second sub-statement does not include the distinguished value. 
An evaluation result of the statement is determined depending on at least whether the evaluation of the first sub- 
statement succeeds or fails. 

[0011] The present invention further provides a computer system that is capable of evaluating a programming lan- 
guage statement and determining an evaluation result of the statement. The statement Includes a first and a second 

50 sub-statement, and the evaluation result of this statement depends on whether the evaluation of the first and second 
sub-statement succeeds or fails. The computer system is capable of evaluating the first sub-statement and determining 
an evaluation success result if the evaluation succeeds, or a distinguished value if the evaluation fails. The computer 
system is further capable of evaluating the second sub-statement and detemnining an evaluation success result if the 
evaluation succeeds or the distinguished value if the evaluation fails. The distinguished value is a value that Is not 

55 included in the range of possible evaluation success results. 

[0012] The accompanying drawings are incorporated into and form a part of the specification to illustrate several 
embodiments of the present Invention, These drawings, together with the description, serve to explain the principles 
of the Invention. The drawings are only for the purpose of illustrating alternative examples of how the Invention can be 
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made and used and are not to be construed as limiting the Invention to only the illustrated and described embodiments. 
Further features and advantages will become apparent from the following and more particular description on the various 

embodiments of the Invention as illustrated in the accompanying drawings, wherein: 

FIG. 1 illustrates a computer system according to the invention; 

FIG. 2 is a general flow chart illustrating the pattern-matching technique of the invention; 

FIG. 3 is a more particular flow chart illustrating the pattern matching technique of the invention; 

FIG. 4 is a flowchart illustrating the evaluation statement process of the invention; and 

FIG. 5 illustrates an example of the hierarchy of types in a programming language based on the techniques of the 
invention. 

[0013] Referring now to the drawings and particularly to FIG. 1 , which Illustrates a computer system of the present 
invention, processing means 1 00 is provided that is connected to an input section 1 1 0 and an output section 1 20. The 
processing means 1 00 can be of any type and has access to a program code storage 1 30 that stores the programming 
language statements and expressions that are operated on by the invention. The system further comprises in the 
example shown in FIG. 1 . a statement evaluation section 140 and a pattern matching section 1 50 including instructions 
that allow the processing means 100 to operate as discussed in more detail below. 

[0014] Before going into the details of the invention, an example of a general abstract syntax for terms of the under- 
lying language is provided, where the notation of e encompasses imperative and declarative statements. Operational 
semantics is described by using the SOS style described In G. D. Plotkin's article "A structural approach to operational 
semantics", Technical Report DAlMl-FN-1 9, Computer Sciences Dept., Arhus university, Denmark, 1981, considering 
"small step" transition in order to cover an eventual extension to concurrent languages with interleaving semantics. 
[0015] The first set of definitions is now provided that describe basic constructs that can be considered as universal. 



30 



35 



40 



e n I s ] true | false 
none [ unit 
8 * e 

if e^ then ea else ez 
var X = e-e 



e ::= true I false 
e ~ e 1 e != e 



constants: numerics, strings, booleans 

distinguished values 
basic operations {* € {+, /}) 

boolean choice 
variable declaration 
variables 
boolean literals 
equality and difference comparisons 



45 



50 



[0016] The constnjction for the introduction of local variables 



var x~e in e 



is often noted 



55 



let x~e in e 

in functional language communities. 

[0017] More sophisticated computation structures, e.g. sequencing, loops and assignment, with widely understood 
semantics are described through the following grammar extension: 
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e ::=e;e sequence 
X . - e simple assignment to a variable 

^ *(e) closure computation 

[0018] A transition system describes an interpreter of the language through a transition relation which defines the 
10 computation of any expression e into a new expression e*, and is noted e e'. Severai computation steps such as e 
e'-^ e" can be abbreviated by using the notation e e'V By definition, terminating computations will reduce e to a 

normal value noted which cannot be reduced anymore; this particular computation step is noted e ~¥0 v, and a 
derivation chain that reduces to a normal value is noted e -^o v. The relation is formally described through: 

— Qf \_ 1 [norm] 

e ~»o e e ~>o e 

[0019] The formal semantics of basic boolean, string and arithmetic operations (noted * above) wiii not be described 
here, being considered as widely understood, 
20 [0020] The computing environment, as well as the use and notation of variables and references will now be described 
in more detail. The computing environment, noted S, is a mapping from names (of variables) into reduced values: 

S ^ {xj} 

25 

with being a denotation for the mapping of a unique labe! into a unique reduced value u,-. Reference handling 
requires also another execution structure, a heap 

30 ^-ini 

using the same notation provided that r denotes references. The introduction of recursive procedures or functions with 
non>lazy evaluation would simply require a stack of mappings in order to handle local environments. The entire envi- 
ronment H, S Is sometimes abbreviated by V. 
35 [0021] In another notation, the computing environment is noted r as the mapping from variable names Into reduced 

values: 

40 

[0022] Further r^x^' is an abbreviation of H,SO{x^}, or ru{x^'}, respectively, and similarly F, A is an abbreviation of 
Hu{/^'}, S. The transition relation becomes nowH-e^n-e' in the general case, although invariant execution structures 
can be skipped for clarity when required. This relation means "expression e computed in environment H, S becomes 
e'ln environment H'.S"', understood that H'and S'can be equal to or different from Hand S. The following equations 
45 describe the semantics of variable access [var] and declaration [d1 ,d2]: 

r, x^ I X r, x^' i u [var] 



r ^-- var x= e^ .eg r i- var x=e\,e2 
F I- e^ T ^ X) 

55 ' [d2] 

r I- var X = .©2 -> r. ©2 

[0023] Reference creation and dereferencing involve intemnediate distinguished values r (references) on which no 
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15 



Other operations are defined, as opposed to pointers and pointer arithmetics. 



n- @\) r, h r[ref2] F. /""^ [-- If F, h- d [dref2] 



[0024] In [ref2]. it is to be mentioned that a new unique reference r is created in the Heap and that this reference is 
10 returned as result of the connputation of 

[0025] In the testing operation, environment modifications are allowed during evaluation of the boolean part. This 

enables the use of a matching operation as a condition for the test. 



Fh- r h e\ 



F h if then else 63 F' h if e'^ then ©2 ©^se ^3 



[ifl 



if true then ©2 ®ise -> ©2 O^"' ] ^^'^^ ^^^^ ^2 ^3 ~^ ^3 0^2] 
[0026] The semantics of the basic numerical operations + ,/,*,- is well known in the art. The + operator Is polymorphic, 
20 i.e. it applies in various semantics to numerals, strings, sequences, concatenations, multisets . disjunctive unions, I.e. 
m^+m2'rr)^m^.. and dictionaries (non-commutative, right priority). 



PATTERN MATCHING 



25 [0027] The pattern matching technique, which will now be described in more detail, evaluates a first code structure 

that represents an expression, analyzes a second code structure that represents the filter to be matched by the ex- 
pression, and filters the vaiue determined by evaluating the first code structure according to filter charactehstics de- 
termined by the second code structure. The first code structure, hereafter denoted "data structure" and the second 
code structure, hereafter denoted "pattern structure", are constructed symmetrically so that matching operations can 
30 be specified on various and arbitrary complex data structures, such as strings, sequences, sets, dictionaries and 
records, but also on trees, DAGs (Directed Acyclic Graphics) and genera! graphs. This will be shown in more detail 
hereafter. 

[0028] In the following, it is assumed that it is possible to declare local vahables which will potentially be assigned 
to parts of or to the entire filtered structures. Expressions, such as e, can be literal constants, variables or basic 
35 operations, such as e+e, e*e. References are considered because they allow the sharing of substructures and the 

modeling of DAGs and graphs. 

[0029] Pattern matching operations make it possible to check a given expression e for whether the expression con- 
tains a structural pattern, and to extract a part of Its content, in a single operation. A pattern matching operation is 
made up of three parts: The first part Is an expression e against which the filter Is to be checked. This part is called 
40 the subject. The second and third parts are the pattern-matching operator # and the filter t The subject can be a 

variable, a constant^ or a more complex expression that will be evaluated prior to matching. 
[0030] Thus, a pattern matching operation looks like 
e#f. 

[0031] These operations return a boolean value. If the operation succeeds, meaning that the expression matches 

45 the filter and, optionally, that variables have been assigned to a part of the subject's content, then It returns true. If it 
fails, meaning that the expression did not match the filter structure or that it did not contain a given value, then false 
is returned. 

[0032] By convention, nomnal values are noted vor n, s if they are numenc orstnngs, respectively As shown above, 
a derivation chain that reduces to a normal value Is noted e -^0 v. The genera! semantics of the matching operation e 

50 # /'requires in the following order: the evaluation (step 300 in FIG. 3) of the left operand e (nonnalized to v), the 
evaluation (step 31 0) of the right operand, i.e. the filter f, and the application (step 320) of the filter to the normalized 
value, which returns either true or false. It wKI be appreciated that the term "value" does not necessanly relate to a 
numeric value as the expression may be a non-numeric expression. Moreover, the environment might be modified by 
the matching operation, whatever result is obtained. Nomnalized filters are noted as bold letters. The formal semantics 

55 of matching operation is twofold. The first stage computes a reduced fomn first for the subject ([matchi] iterated) and 
then for the f liter ([f-match1] iterated): 
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.[match 1 ] r— — -~ , \ „ [f -match 1 ] 



r h e # / ^ r h e' # / ' r h -u #/ ^ r' h X) #/' 

[0033] The last stage, i.e. the filter application itself, depends on the filter and data structure considered and will be 
5 defined case by case in the following. 

[0034] Examples of structure constructors are now presented in order to Illustrate the symmetry between them and 
the corresponding filter constructors described below. The structure constructors and filter constructors are indicator 
elements indicating the respective data type: 

^0 {e^, Sg. ...} Multiset: a collection type in which elements are not ordered and which can contain 

multiple instances of the same value 

[e^, e^, ...] Sequence: an ordered collection of elements of a common type 

^5 <e^. e^, ...> Tuple: an ordered collection of elements which has a fixed size. Elements need not 

be of a common type 

<namei ~ e^. name2 - Gz, ■ ■ Record: an unordered collection of named elements 

20 {key-, = , keyg = e^, ...) Dictionary: an unordered collection of elements that are each accessed by a key. Each 

key must be unique 

@(e) References: a reference to a value (itself computed from an expression e) stored in 

memory 



25 



De- referencing operator, used to access a referenced value 



[0035] Further, there is provided a + operator that can take different semantics depending on the data structure, e. 
g. arithmetic addition, string concatenation, set union, etc. 
30 [0036] Filters are expressed using a small number of operators and can describe many different structures. Besides 

this, filters closely resemble the structures to be matched, making them rather easy to specify. Filters can match se- 
quences, multisets, tuples, records, dictionaries, strings and any combination of these structures. Afi filters are built 
using three basic filter operators, in addition to filter constructors which use the same notation as their data constructor 
counterparts. The three basic filter operators are the test operator, the existence operator and the assignment operator, 

35 [0037] The test operator, noted % In the present example, is used In conjunction with a constant, variable or complex 
expression, which will be evaluated prior to matching. It tests the occurrence of the value given by its operand at some 
point in the structure. For instance^ 

e # %'circus' 
tests whether e is a string equal to 'circus' or not. 

40 e # [%(2+2) °/o3] 

checks that e is a sequence having one item of value 4 and one item of value 3 in that order. 
[0038] The existence operator, noted ?, is defined as 'match any element'. For instance, 
e #<?,?> 

matches any tuple that has exactly two elements, like 

45 <'circus', 47>. 

[0039] The assignment operator, noted ?x, where x is a variable name, is used to extract a part of the subject and 
assign this part to x. For instance. 
e#<%'cincus',?,?y> 

will succeed if e Is a tuple containing three elements. The first element has to be the string 'circus', the second one 

50 can be anything, and the value of the third element is assigned to variable y. The same pattern matching operation on 
a sequence would be very similar: 

e#[%'circus',?,?y] 
changing only the constructor from tuple to sequence. 

[0040] In addition to these basic filter operators, there is provided a concatenation operator, noted ++, that combines 

55 compatible elements. It can be seen as the dual operator of the concatenation operator (noted +, see above) of data 
structures. For instance, the string 'circus' can be thought of as the concatenation of three substrings 
'ci'+'r'-f'cus'. 

[0041] In a symmetrical way, the filter appears as 
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e # % 'cj' ++ %'r' ++ %'cus', 
[0042] For finding strings containing character 'r*, the fitter 

? ++ %'r' ++ ? can be used, which means zero or more elements, plus the letter 'r', and a further zero or more 
element. This operator can be used with any structure, making it possible to take other elements into account. For 
5 Instance, e # [?x] matches only sequences consisting of exactly one element, and assigns this element to x. To express 
the fact that a sequence e must contain at least one element, without any ordering, ? combined with the ++ operator 
can be used: 

e#? [?x] 

[0043] For illustrating the advantages of the present structural pattern matching scheme, more complex examples 
10 are now given for strings, tuples, sequences, records, multisets and dictionaries. 

e # ? ++ %V ++?x will match any string containing V and assign the substring beginning after the first occurence 

of 'r' to variable x: if e='circus', then xwill be assigned 'cus' ; if e='red', then xwil! be assigned 'ed'. 
e#[<f1=?x>] ++? 

will match any sequence containing one record as the first element. This record must contain a field ft, the value of 
this field will be assigned to variable x. 

[<f1=10>, <f2='s'>,<f1=3>] # [<f1=?x>]++?y 
wilt succeed; xwill be assigned 10 and y will be assigned [<f2~'s'>, <f1~3>]. 

e#{?++ [<?,?x>]} ++? 

will match any multiset containing at least one sequence whose elements are tuples made up of two elements and will 
20 assign the second element of the last tuple of a sequence in this multiset to variable x. It will select the last tuple of a 
sequence because the pattern structure includes ? ++ [<?, ?x>] instead of [<?, ?x>] ++ ? which would have selected 
the first tuple. 

{'ab', 'cd\ 'ef) # {%'ef ,%'ab\%'cd'} 
will match since the order Is irrelevant in sets. 
25 [0044] Pattern matching can further be used to retrieve values from a dictionary. Suppose a dictionary which maps 
some strings to some sequences, 

dict#{'k1'-?} ++? 
will succeed if diet contains a key 'kV, and 

diet ^ {'k2'=:?x} -H- ? 

30 will succeed rf diet contains key 'k2' and will assign the corresponding sequence to variable x. 

[0045] Since pattern matching operations return boolean values, they can be composed using logical connectors, it 
is then possible to express filters which succeed only if the subject does not match the filter, or complex filters. There 
are three composition operators, "not", "or" and "and", "not" will succeed if the subject does not match the filter. For 
instance, 

35 e # not (? ++ %'r' ++ ?) 

will succeed only if string e does not contain the character V. 

[0046] "or" takes two filter arguments, which are matched from left to right. For instance 

e # %'c' ++ ? or ? ++ %Y ++ ? 
will succeed only if string e begins with the character 'c' or if it contains the character 'r'. 
40 [0047] "and" works in a similar way as "or". It succeeds if the expression matches both filters. For Instance, 

e #<?,?> and ?x 
allows checking that e is a two-element tuple and assigns e to x. 

[0048] There are also provided "Kleene" operators * and + that work with the known semantics, "zero or more ele- 
ments" and "at least one element", respectively. 

45 For instance, 

e # %'abb' ++ {%'c')* ++ %'dee' 
will match any of the following strings: 'abbdee', 'abbcdee', and 'abbcccdee'. 
The same filter using the second operator, 
e # %*abb' -h- {%'cy ++ %'dee' 
50 will match the same set of strings except 'abbdee'. The Kleene operators can be used with sequences, sets and dic- 
tionaries. 

[0049] As shown above, the described pattern matching technique enables the symmetrical constructions of both 
pattern matching structures and data structures, so that they reach the same arbitrary level of structural complexity. 
Further, the matching operation is Invoked explicitly, through a dedicated operator. The general fonn of the structure 

55 to be matched is tested as well as the contained (sub-)structures and the assignment of part(s) of the matching structure 
to variabie(s) of the execution environment. 

[0050] The technique relates to a number of fields including those of language construction, control abstractions and 
transformations models, rewriting systems theory, term rewriting systems, transformation languages or systems for 
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compilation and language processing, structured document transfomiatlon, tree pattern matching, explicit or automatic 
document transformation systems, and so on. 

[0051] Further the technique may serve for building transformation modeis which are less abstract and more genera!, 
than rewrite systems, which perform implicit pattern matching and apply built-in strategies for rule application. The 
5 technique is on the other hand abstract enough to simplify and extend genera! purpose programming languages. Thus, 
the technique may play an important role in the design of new transformation techniques or the extension of existing 

ones, 

[0052] Four basic topics are addressed in a single approach different to and independent from existing ones that are 
currently and conceptually less efficient; the definition of a data model, the definition of matching operations, the def- 

10 inition of a transformation model, and the integration of the transfonnation model in a programming language, 

[0053] The definition of a data model Is to give a precise form to the notion of data structures, which need to be rich 
and clear for the programmer but at the same time kept as simple as possible. The computational properties of each 
kind of structure should be stressed to reach completeness at minimal cost. For instance, sequences are ordered 
structures that are useful for handling stacks, fifo's, or to memorize intermediate nodes when walking through a tree^ 

^5 whereas multisets are useful for managing "bags" of unorganized data, 

[0054] The technique described above proposes a "universal" data model based on a synthesis of the most commonly 
used data types. These are chosen in order to avoid redundancy and to enable the construction of heterogeneous 
structures of arbitrary complexity while being kept simple and explicit. However, applying the technique does not require 
using exactly the proposed type set, but only applying the symmetrical construction principle, both to data structures 

20 and to pattern structures. 

[0055] The definition of matching operations is clearly related to the previous point, This covers three fundamental 
issues: identifying and testing the "form" of the structure, (step 200 in FIG. 2); check the vaiue of the structure (or a 
part of it) {step 210); and extracting a part of the information stored in the structure (step 220). 
[0058] The technique allows for building pattern matching structures in such a way that the required fomi is made 

25 explicit, thus clear to the programmer who specifies It. Parts of the subject structure which are not of Interest are 
abstracted through a basic existence filter noted "?", Values inside the structure can be checked as equal to arbitrary 
complex values, thanks to a basic testing filter noted "%", e being a potentially complex expression. Finally, information 
located in the subject structure can be extracted and copied to any variable that is available in the execution environ- 
ment, by using a basic assignment filter, noted "?x", where x is a variable name. 

30 [0057] The definlllon of a transfonnation mode! starts from the finding that matching operations are just intermediate 
steps of realistic structure transformation processes and should therefore be put in a more general context: How are 
transformation steps described, chained and ordered? How are structures scanned and what is the result of the overall 
transformation? How is the contextual Information extracted that is used during matching operations: is It simply trans- 
ferred into the output structure(s) and/or does it drive the transformation Itself? 

35 [0058] The explicit Invocation of the matching operation, according to the present technique, allows one to see it as 
a boolean evaluation. The transfonnation model can therefore take an useful form, depending on the requirements. 
The transformations can cascade matching operations by using rules like e.j # f.j ^ 62 #f2 ^ or composed sequen- 
tially or through complex networks of "If -then-else" statements, possibly comprising computation on the extracted con- 
text. Output structures, the result of the transformation, are constructed in a coherent way by using the available data 

40 models and contextual infonnation, possibly transfonned by other computational means. 

[0059] Depending on the definition of the transfonnation model and the expected computational power of the trans- 
formation, one can consider either to extend the pattern matching with language constructs to specify internal compu- 
tation, as a complement to matching operations, or to integrate the transfonnation model itself into a more general 
programming language, as an extension which increases expressiveness. Both options are made possible by this 

45 technique, thanks to the explicit matching operator and the few general, and modular, assumptions regarding the 
underlying language. 

[0060] Considering the above observations. It will be appreciated that the described pattern matching technique is 
in particular suited for supporting genera! typing mechanisms. Type checking improves the global reliability of program- 
ming languages, and provides efficient means for runtime optimization. 

50 

Pattern Matching Syntax and Operational Semantics 

[0061] As noted above, the general abstract syntax uses efor expressions and ffor pattern matching filters. Matching 
operations are invoked through the operator e # f where the left expression e is the subject and the right operant f Is 

55 the filter or pattern. 

[0062] There are provided four basic operators plus combinators (or filter connectors): 
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f ? existence test 

^ ?x existence test and assignment to variable x 

%e equality check 

@f ref. filter 

f::=f++f filter composition 

f I r kleene-like operators 

f and f ! f or f I not f boolean (ordered) connectives 

15 



[0063] The first two filters ? and ?x are under normal fonn. The computation of the equality check and of reference 
filters requires the computation of their embedded expression; 

20 



[0064] By using a meta symbol * E { ++, and, or }, we define a family of equations valid for all binary combinators: 

25 

^ ^ [f-left] ~ — [f-right] 



/r/2-^/r/2 /r/2->/r/2 

30 [0065] The reduction of the kleene-like operator f* preserves the structure of the filler ([f*]) whereas the computation 

of f-^ is a pure rewriting ([f+J): 



35 

[0066] In the semantics of filter application (matching), vand w denote reduced terms: 



40 



\) # ? -> true [m-free2] r, I- w # ?x -> r, x*^ I- true [m-free1] 



r 1) # f ^ r* h- true t)i = Do true/false 

i,r ,r ^ true ^ 2 

r. i r # @f ~> r\ r' I true ^i * '^^^a ~^ true/faise 



45 [0067] It is to be mentioned that [m-%] uses again the structural equality on structures, This last is defined for all 
considered structures as = iff q and 3S^, The inclusion itself is straight forward for strings, sequences 
and multisets; for dictionaries, it corresponds to the inclusion of key/value pairs. 

[0068] The composition combinator ++ applies only to strings, sequences, multisets or dictionaries. It can be ab- 
stracted over these various data structures, noted s, by using the + operator which models concatenation for strings 

50 and sequences, disjoint union for multisets and non-commutative union for records and dictionaries. As keys must be 
unique in a dictionary, the key/vaiue pairs of the right hand operand override the key/value pairs of the left hand operand^ 
if required. This does not impact the semantics of the related matching operation. The following definition uses again 
the equality relation on structures: 



55 
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[m-faddl] 

3«i»»3 I -f S2 = sxSfa-^tnie «2lt^3->toie 

8 I fi-H-fa -f true 



Vsi, 52 such that + ^2 = « 



gi I ft -» false 
s I fa-H-f3 false 

fix H fi tnie 52 8 fa fabe 
6 H fj-f+fa ^ false 



[m-fadd^ 



[ni-fadd3] 



[0069] Similarly, In the following definition whicli applies only to strings, sequences, sets and dictionaries, the ternii 
£ is an abstraction over empty string, empty sequence, empty set and empty dictionary: 



if«^e 3«i,«2 I « = «i + «3 «ittf--^tnie «2|f*->tnie 



«|f*->tnie 
e$f* -^tnie [in*b] 



[0070] In the following equation, the order of operands is innportant, and computing environments can be altered by 
unsuccessful operations. This enables more efficient implementations since no specific processing Is required in order 
to preserve the original environment: 



[m-andl] 

r h t; S fj andfa r" h true 



[m-ajid2] 
PHpltfa false 

r h v f fi andfa -+ r' h false 



[m-andS] 

rhvf fiandfa-^P'hfalse 



[0071] A similar behavior Is defined for "or" filters: 



[m-orl] 
r h p t fi r h tine 

FH vffiorfa-fn-tme 



[in-012] 

rht;|fiorfa-4P'HtrBe 



[m-cnr3l] 

ri-vifi-^ri-falsc rht^jfa-^Fhfalse 
rn v|tfiorf2-+P'hfalsc 
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[0072] Similarly, the "not" filter is: 

r H u # f ^ r' h true/false 
ri- D # not t. -> r' h false/true '■"^''^^^^ 

5 » 

[0073] Of course, backtracking might be convenient In cases where the matching failed and stil! !et the environment 
changed. Further a solution by the mean of an explicit restoring operation v{f), may have semantics 

f f TV t) # f r' h true J. . D- \) # f r' I- false . ^, 

V(/ )-> V(/) ^ ^ n - D # V(f)) r I - true ^"^^ n- v # V(f) r \- false 

[0074] The symmetrical construction of data and filter structures will now be described in more detail in the examples 
of tuples, sequences, multisets, dictionaries and records. 
?5 [0075] Tuples allow to handle heterogeneous structures of fixed length. The present description will present only 
constructors. Other common operations on tuple stmctures are: access to Items through indexing notations such as f 

[/], in order to fetch the item, or assignment % e, in order to set the item, provided that / corresponds to the 
actual size of the tuple. Tuples are particularly useful for computing cartesian products such as done in relational 
algebra and related languages: 

e <e^, e,^> tuple construction (/c + 1 items) 

/ </q, ...» f^> filter for tuples of ^ + 1 elements 

[0076] In the following part, e is noted as a shorthand for Gq, e^. The computation of a tuple (or a filter tuple) is 
defined by the successive computation of all subterms, In the order of occurrence. A tuple or filter tuple is reduced 
when all subterms or sub-filters are reduced: 

^\-^^\ r. ...... 



[tuple] — ~ , [f-tuple] 



35 [0077] Matching for tuples Is performed by matching all subfllters to corresponding substructures. If the subject v is 
not a tuple, or if cardinalities are different, the operation returns "false" {[m-tuple]): 

r h -Ua # ffi r^^^ I- true ... H^'^^ h # f t ^ r^^^ ^ true 

2—^ [m-tupie] 

40 r H <\>Q,...: x>i^> # <fo,-^., f/^> r ^' V true 

[0078] It is to be mentioned that potential modifications of execution context are propagated through the whole match- 
ing process. 

[0079] Sequences, multisets and dictionaries are defined as shown below: 

45 

= [eo I {eo ^k} (ordered) sequences, multisets 

= {^0=^ ^o', ^k-^k*} dictionaries (unordered key/value pairs) 

50 , , 

= Q 1 {} 1 {=} empty sequence, multiset, dictionary 



55 



/ [/o» "-//f] ' {/o fk^ sequence/multiset filters {k > 0) 



{/o-/o> ■ " dictionary filters {k>0) 
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with: 



[seq] '- '- ; [f-seq] 



[0080] Equivalent equations for seta, called [set], [set2], [f-set] and [f-set2]. are strictly similar to the previous one: 

// -* // 

' ' [set] ; [f-set] 



[0081] When matching sets St^-^^ denotes the set {v^, v^Jand Sfl^-k] the filter {f^j, /y. If /G [0,^], the sE^Wi} is 
equivalent to {v^, V/+^, v^, andsimilarly for SftWW. Using this notation, thematching oversets is recursively 
defined as: 



di, J € 10> *J sHCft that I ^ ^ gim-^) ji gj?£o,fcl-{i} r h true 



[0082] This equation does not express any ordering in exploring the search space. It just requires that each value 
in S nnatches a corresponding filter in SF. Note that the computing environment can be modified throughout matching 
operations. 

[0083] Dictionaries are computed by successive evaluation of key/value pairs^ following the occurrence order: 



Bi 



{\>(rX>o: ->Gr^i' -'^fr^k^ ~^ {'^o=^'^0''->^r^]' -^^ir^k^ 



^ [die] 



~> Bj 



[dic2] 



[0084] Computation of filter dictionaries is strictly similar, and therefore, corresponding equations [f-dic], [f-dic2] will 
not be shown here. 

[0085] When matching dictionaries, Dt^.k] denotes the dictionary {Vff=VQ\ Vf^ = v^'} and Df^^>^^ the filter {/^ = fQ, ... , 
fk = ^'k)- Using this notation, the matching over dictionaries is recursively defined as; 



3«*ii€[0, At] such that 



r' h true 



r h DtM] I JDJplo.*] ^ p'' h true 



[m-dic] 



[0086] This equation does not express any ordering in exploring the search space. It just requires that each key/ 
value pair matches a corresponding fllter-key/filter-value pair. Note that the computing environment can be modified 

throughout matching operations, and that keys are matched prior to values. 

[0087] Records are unordered and heterogeneous collection of values which can be statically designed by a name 
called "member". Standard operations on such data structures s are member access, e.g. a := s.m, or member assign- 
ment, e.g. s.m := 10. Record provide useful mnemonics In order to select a part of complex staictures and are well 
known for their expressive richness in data modeling: 
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e (Wo = ^o»-i % = ) records (unordered member-name/ 

value pairs) [k > 0} 

/ <mo=/ov.Mmi=/,) record filters (fc > 0) 



[0088] The reduction of data and filters follows the order of occun'ence: 



^ ' [e-rec] 



[0089] Filter records are similarly defined: 



' ' [f-recorcl] 



[0090] Matching is not order sensitive, i.e. the ordering of filters can differ from the ordering of the subject, but filters 
are applied through their definition order. Member names must be exactly Identical: 



3 disdnct to» * ' . I lib € [0 * -fc] siidi that 



= rm, and T^*"^) V- v^, J T^*) h true 



r h {mo=^o» • ' 1 rn^^Vk) } (m(j=fo, ^ . . > w5,=drip) -4 fC^) H true 



[m-record] 



[0091] The matching falls if one of the sub-matching fails: 



3 distinctio, • . - , V € [0 • ' < ^ such that 

n^^tTHo «nd r h v<j, I fb -4 r<^) h true 

F+- (mo=vos . . . ^mk^k) i «=<o, • . . jwi^tfe) rO^ h false ^ 



Recursive Fitters 

[0092] Recursive filters and the "do" operator will now be described In more detail. 

[0093] Recursive filters enable the filtering of trees. For instance, 

e # rec F= <%'pius',F.F> or <%'minus',F,F> or <?> 
succeeds if e Is a tree with nodes that are labeled by strings 'plus' and 'minus' and with leaves that are tuples containing 
a unique element (of any structure). 

[0094] The "do" operator takes a filter as the left argument and an instruction (or sequence of Instructions) as the 

right argument. Instructions are executed only tf the filter is successful, 
[0095] For instance, 

E#<%12,?> dol:=i+1 

increments /only if e is a tuple made of two elements, the first one being 12. This operator can be particularly useful 
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in recursive filters. 

[0096] Using "do" It Is possible, for instance, to extract all the numbers from a tree based on the previous example 

and append them to a list n. The extend filter A is Is 

rec F= <%'plus',F,F> or <%'minus',F.F> or {<?x> do n:=n+ [x]) 
[0097] In a basic example such as 

<'plusV<'minus',<1>,<2»,<4» # A 
where the tree encodes (1-2)+4, the pattern matching operation succeeds and n is equal to n+[1 ,2,4] after application. 
[0098] The syntax and operational semantics of recursive filters and the "do" operator is described hereafter: 

f rec F = f | F recursive filter and recursion variable 

f do e "do** operator (e is executed if f matches) 



[0099] As described above, these filters are reduced by preserving their structures. Reduction of the "/do e" filter 
differs from reduction of the "%e" filter because the embedded expression e is not computed. It will be evaluated in 
the context of the matching operation, and only if required: 

f ~> f f ~> f 

— J z [e-rec] -v-. -^v,--,- [e-do] 

rec F = / rec F = /'" ^ /doe->/doe ^ 

[0100] Recursive matching Is defined by using a substitution operation, as e.g. in the standard ^-reduction of the 
lambda calculus: 

n D#f[recF^ f/F]-^ri true/false . , 
r 1 - 1) # rec F - f -> r 1- true/false ^-^'^^^ 

[0101] In the following [m-do], the evaluation of e is done only if the filtering operation is successful. In that case, the 

new context is used, thus allowing side-effects such as the memorization of useful intermediate information: 

r I - -0 # f r' h true r f~ e -^0 r" ^w.,, r h 1) # f ~> r' \ - false r 
ri^#fdoe-.r"l true t^'^^' n # f do e r" I false ^^'^'^J 

[0102] For illustration purposes, the technique described above is now applied to an example of managing a database 
of book references. The data is stored in a Set structure (unordered collection of records) describe hereafter. 
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const DBase = { 

< year = * 1994 ' , 

title = 'TCP/IP Illustrated', 

author = [ < last « 'Stevens'", first - 'W. ' > ], 
publisher = ' Addison'-Wesley' , 
price = 65 .95 

>, 

< title = 'Advanced Programming in the Unix environment', 
year = '1992', 

author = [ < last = 'Stevens', first - 'W.' > ], 
publisher = ' Addison^Wesiey' , 
price « 65.95 

< year = '2000' , 

title = 'Data on the Web', 

author - [ < last == 'Abiteboul' , first 'Serge' >, 

< last - 'Buneman' , first ~ 'Peter' >, 

< last « 'Suciu' , first « 'Dan' > 

publisher = 'Morgan Kaufmann Publishers', 
price 39.95 

>/ 

< year = '1999', 

title = 'The Economics of Technology and Content for Digital 
TV , 

editor = < last = 'Gerbarg' , first = 'Darcy', affiliation « 
'CITI' >, 

publisher = 'Kluwer Academic Publishers', 
price « 129.95 

> 
} 

[0103] Hov\i, exainpies are given to extract, firter and recombine book information by using the filtering primitives and 
structured pattern constructors. 

[0104] For finding all books from Addlson-Wesley that are published between 1990 and 1999, and for storing the 
titles, a recursive function F1 Is defined that also returns the result In a Set: 



function Fl{x) is 
if 

x#{ < title=?t,publisher=% 'Addison- 
Wesley' ,year«%' 199'++? > 
++?}++ ?y 

then 

return Fl{y) + { < title = t > } 
else 

return {} 



[0105] If F1 Is called with the book database as parameter (written F1{DBase)) the result is 
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{< title = 'Advanced Programming in the Unix environment' 
< title = 'TCP/IP Illustrated' >} 

[0106] The rest of the information is not return in the result, e.g. the authors. The following variation, which is also 
perhaps nnore legible, does this job: 

function Fl (x) is 

if 

(x#{?book} ?y) and 
(book#< title=?t,publisher=%'Addison- 
Wesley' ,year=%'199'++? > 
++ ?) 
then 

return Fl{y) + {book} 
6 1 se 

return { } 

[0107] This last example shows the interest of having explicit filtering operations: the first application is done on the 
parameter xand the second on "book". The equivalent solution below shows the interest of the "and" filter; the previous 

"and" is just a standard boolean connective. 



function Fl (x) is 
if 

x#{ 

(< title=?t , publisher=% ' Addi son-Wesley ' , year=% ' 199 ' ++? 

> +4- ?) 



and ?book 

}++?y 
then 

return Fl{y) + {book} 
else 

return {} 

[0108] For finding all publishers known in the database, the filters are used in another construction: the "for" loop, 
has for instance the following syntax 
for f in e1 do e2 

where flsafllter, a computable expression that evaluates to a Set or a Sequence, and e^any programming statement. 
This loop applies the filter to all elements of the Set/Sequence, and if successful, executes e^. The solution is then: 

for <pubiisher=?p>++? in DBase do (R := R+{p}) 
[0109] This result of this program is found in R, with R being supposed to be empty before the execution: 



R={ * Addison-Wesly ' , 
' Addison-Wesley * , 
*Morgan Kaufmann Publishers*/ 
'Kluwer Academic Publishers*} 
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[0110] As can be seen, the Addison-Wesiey publisher is repeated twice. One might want to have a real "projection" 
of the Information, and for that, can use an additional filter: 

^ for <publisher=?p>+4? in DBase do ( 

if not (R#{%p}+-*?) then R:«R+{p) 

) 

[0111] The result of this program Is as expected: 

10 

R«{ ' Addison-Wesly * / 

'Morgan Kaufmann Publishers*, 
'Kluwer Academic Publishers'} 

15 

[0112] For finding all authors having last names that begin with 'A', the following construction can be used; 

for <author=?s>++? in DBase do { 

for <last=(%'A'++? and ?auth)>-f+? in s do ( 
if not (R#{%auth}++?) then R := R+{auth} 

) 

) 

25 

[0113] The result will be {'Abiteboul'}. 

[0114] It will be appreciated that the presented pattern matching technique is suitable for either designing program- 
ming languages specialized in data structure transformation, or for facilitating extensions to existing languages in order 
30 to handle such transfomiations. The construction of data structures and pattern matching structures, i.e. fitters, of 
arbitrary complexity uses symmetrical constructors, thereby allowing for great simplicity. The definition of basic filters, 
structured filters, recursive filters and logical combinators provides any programmer with means that have a high ex- 
pressive power and a good level of simplicity. A boolean operator is provided that allows to apply explicitly the pattern 
matching structure to the subject data structure. Further, a formal operational semantics Is provided that defines pre- 
ss cisely the nature of filters and of the matching operation as we!! the relationship with any associated computational 
model. Moreover, this formalization offers a flexible theoretical framework that can help further integration. 

BI-VALUATION OF PROGRAMMING STATEMENTS 

40 [0115] By means of the statement evaluation section 140, the computer system can perfomi the process which is 

depicted in FIG, 4. A programming language statement may include a first and a second sub-statement, in step 400, 
thefirst sub-statement is evaluated, and depending on the decision in step 41 0, the second sub-statement may likewise 
be evaluated. As will be shown In more detail below, statements exist that require the evaluation of the second sub- 
statement whereas on the other hand, there are also statements where evaluation of the second sub-statement Is not 
45 necessary in each case. 

[0116] When the first and/or the second sub-statement is evaluated in steps 400, 420, an evaluation success result 
is detemiined if evaluation succeeds or a distinguished value is returned if evaluation falls. In the following discussion, 
the distinguished value is noted "none", 

[0117] The provision of a distinguished value in addition to the set of possible evaluation success results Is called 

50 bi-vaiuation, 

[0118] The bi-valuation technique makes it possible to combine imperative and declarative statements in one pro- 
gramming language. Basically, both imperative and declarative statements are evaluated when executed and either 
return "unit", a value, or "none". The value "unif is returned for imperative statements since imperative statements 
always succeed. A value Is returned for declarative statements which succeed, and for declarative statements which 

55 fail return "none". 

[0119] It is therefore possible to combine both kinds of statements using so-called imperative connectors, like 'Then" 
or "Else" having semantics that are based on the evaluation of the statements. Conditional, imperative, declarative 
statements and imperative connectors are described below in more detail. Further, it is demonstrated how imperative 
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connectors are used for mixing statements. 

[0120] In the following, sand S; denote one or more imperative and/or declarative statements combined together by 

imperative connectors. The term 'to evaluate s' means 'to execute the statements in s and return the evaluation of the 
last statement in s'. Expressions like e, e^can be literal constants, variables or basic operations like e-t-e, e *e. 
5 [0121] Conditional statements, or if-then -else statements, are noted 
If (e) then (s^) else ($2) 

where e is a boolean expression. Depending on whether e evaluates to true or false, or is evaluated, respectively. 
[0122] As opposed to declarative statements, imperative statements always succeed, and evaluate to "unit". One 
example is the assignment, noted x:-e, where x is a variable identifier and e is an expression. It assigns the result of 

10 the evaluation of e to x. Another example is the closure loop, noted *{s). The loop ends when s evaluates to "none". 
Its semantics is as follows: 

If (s != none) then *(s) else unit 
[0123] Declarative statements are based on conditions. The evaluation of a declarative statement returns a value if 
the condition(s) is verified, "none" otherwise. Examples are rules, ordered action systems and unordered action sys- 

^5 lems. 

[0124] The Rule is noted e s where condition e can be a boolean or a pattern-matching expression. If the condition 

is verified, meaning that the pattern has been matched or that the boolean expression has evaluated to true, then the 
rule fires, triggering the evaluation of the right hand side s. Rules are commonly used in rewriting systems by combining 
them in constructs similar to action systems. 

20 [01 25] The (ordered) action system Is noted [1 , s^, . . . , 1] and can be compared with a powerful Switch construct. 
It is used to combine rules. The action system evaluates them one by one until it finds one that does not evaluate to 
"none", i.e. a rule which fires and that has right hand side statements that do not evaluate to "none". The action system 
itself returns the result of the evaluation of these statements. Action systems can also contain an imperative statement 
in the last position which will act as a default case since imperative statements always return "unit". 

25 [0126] The unordered action system Is noted { I s^, Sg., 1 } and does not guarantee the order of evaluation of 
rules, i.e. the order of declaration has not semantic meaning. 

[0127] There are three imperative connectors which make it possible to mix imperative and declarative statements. 
An example set of imperative connectors Is given below; 

[0128] The sequencing operation separates instructions that are to be executed in sequence, 

30 s^;s2;^..;s„ 

wil! execute every statement and return the evaluation of s^. 

[0129] The concurrent operators and ||''' separate instructions that are to be executed concurrently. They have 
respectively logical-And-lIke and loglcal-Or-lIke semantics. Basically, \\^ concurrently evaluates $^ and $2 returning 
"none" when at least one of the Sj evaluates to "none"; "unit" Is returned when both operands evaluate to "unit", l'^ 
35 behaves in the following way: It concurrently evaluates s-| ands2 returning "unit" when at least one of theSj evaluates 

to "unit", and returning "none" when both operands evaluate to "none". A more formal definition of the semantics is 
provided below. 

[0130] The Else operator Else s^ evaluates s^. If evaluates to "none", then is evaluated. The semantics is 
as follows: 

40 var Vf = s^ . if (Vj. == none) then s^ else Vf . 

Vf is a fresh variable, i.e, doesnl occur in the current context nor in or s^. 

[0131] The Then operator Then evaluates s^. If s, does not evaluate to "none", then is evaluated. The 

semantics is as follows: 

if (s^ ! = none) then (sg) else (none). 
45 [0132] The Or operators J Or s^evafuatessy. If evaluates to "none", the evaluation of 5^ is returned. If evaluates 

to "unit", S2 is still evaluated but "unit" is returned, no matter what evaluates to. The semantics is as follows: 
if (s.| == none) then (Sg) else{S2 ; unit). 

[0133] The And operator And evaluates s^. If evaluates to "unit", the evaluation of Sg ls returned, if Sy evaluates 

to "none", ^^11 1 evaluated but "none" Is returned. The semantics Is as follows: 
50 If {S.J ! = none) then (Sg) else {S2 ; none). 

[0134] For operators And, Or, H-^- and ||^, Sj and have to evaluate to "unif or "none", meaning that they have to be 

imperative expressions. 

[0135] Some introductory examples are now provided to get familiar with the notation, and then the expressiveness 
brought by the technique is demonstrated with more complex examples. Variables / and stri are supposed to be re- 

55 spectiveiy of type Integer and String, 

[01 36] A simple sequence is made of an assignment statement followed by a "while" loop containing a rule: this loop 
increments / until it reaches 10. 
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i :=0; 

*{ (i < 10) i := i + 1) 
[0137] In an action system containing a rule, a nested action system is made of rules and an expression; 



[! 

{i<5) (strl 'cir' ; 50 3), 
[| 

<i 100) 'abed', 
(i 200) 'efgh' 

3.1415 

I] 

[0138] If / is less than 5, then strl Is assigned the string 'cir' and the action system returns 47. Otherwise, if / is equal 
to 100 or 200, the action system respectively returns strings 'abed' or 'efgh'. Othenivlse, it returns 3,1416. This last 
expression acts as a 'default' case. If it were not present and if / was not previously assigned a value less than 5 or 
equal to 1 00 or 200, the action system would have evaluated to "none". 

[0139] It is to be noted that action system components do not necessarily contain a simple expression like 50-3 or 
'abed' as the laststatement. They can also contain imperative expressions; in that case, the action system returns "unit". 
[0140] The next more complex example makes use of the pattern matching features described above. Basically, 
pattern matching expressions can be used in place of boolean expressions in the left hand side of rules; they enable 
the recognition of patterns and extraction of parts of a data structure, A pattern matching expression evaluates to true 
if the subject matches and then the rule fires. Otherwise it evaluates to false and the rule returns "none". 
[0141] In the present example, some structural data about an XML file stored in string variable strl are extracted. 
To this end, several numeric variables are created which will count: 

nb_oper)Jags number of openings tags 
nb_c}ose_{ags number of closing tags 
r}b_emp-tags number of empty tags 

nb'prefixed_tags number of prefixed tags (the prefix represents a namespace) 
r)b_xrcejags number of tags having the name 'xrce' 

nb_other_tag$ number of tags which do not have a prefix and are not labeled 'xrce' 

[0142] The first three tests identify the kind of the encountered tag, i.e. opening, closing, empty, whereas the three 
others examine the content of that tag. Since the last three tests are independent from the previous ones and relevant 
only when a new tag is encountered, the tests are split in two action systems combined with a Then connector. The 
variable tags\s a string In which each tag name is appended. When all tags have been tested, the results are displayed. 
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tl 

strl ++ ?str2 -fH- >' ++ ?strl 

nb_open_tags nb_open_tags+l, 

strl #?++%'</'++ ?str2 ++%'>' -f+ ?strl 

nb_close_tags := nb_close_tags+l^ 

strl ?str2 %V>' -^^ ?strl 

nb emp tags :« nb_emp_tags+l 

I] 

Then 
II 

str2 # ? I' : ' ++ ? 

nb_prefixed_tags :^ nb_pref ixed_tags + 1, 
str2 # %' xrce' nb_xrce_tags := nb_xrce_tags + 1, 
nb_other_tags := nb_other_tags + 1 

n 

Then 

(tags := tags + str2) 

); 

print ( 'number of opening tags +str(nb open tags)); 



print ( 'number of closing tags +str (nb_close_tags) ) ; 
print { 'number of empty tags +str (nb_emp_tags) ) ; 
print ( 'number of prefixed tags +str (nb_pref ixed_tags) ) ; 
print ( 'number of xrce tags +str (nb_xrce_tags) ) ; 
print ( 'number of other tags +str (nb_other_tags) ) ; 
print {tags} 



[0143] In this exampie, an action system, i.e. a declarative statement, is composed with another action system and 
with an assignment Instruction, I.e. an imperative statement, and the three are nested In a closure loop. I.e. an Imperative 
statement. 

[0144] To Illustrate the compactness and readability provided by the proposed technique, the same program coded 
with only the closure loop and if-then-else statements is presented in thefollowing. For simplicity purposes, it is assumed 
that boolean expressions In conditions can be replaced by pattern-matching expressions. 
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if (length (strl) > 0) then ( 
5 if (strl #?++%' <' ++ ?str2 ++ ?strl) then ( 

if (str2 #?++%':'++?) then ( 
nb_open_tags := nb_open_tag5 + 1; 
nbjpref ixed_tags := nbjpref ixGd_tags + 1 

) 

10 else ( 

if (str2 # %' xrce' ++ ?) then ( 
nb_open_tags nb_open_tags + 1; 
nb_xrce tags nb_xrce_tags + 1 

) 

else { 

nb_open_tag5 := nb__open_tags + 1; 
nb_other_tags nb_other_tags + l 

) 

); 

tags tags + str2 

) 

else( 

if (strl #?++%'</' ++ ?str2 ?strl) then 



15 



20 



25 



40 



45 



50 



{ 



if (str2 #?++%' then ( 

nb_close_tags := nb_close_tags + 1; 
nb_pref ixed_tags := nb_prefixed_tags + 1 

) 

30 else ( 

if (str2 # xrce* ++ ?) then ( 
nb_close_tags :== nb_close_tags + 1; 



35 



55 
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nb_xrce_tags := nb_xrce_tags + 1 

) 

else ( 

nb_close_tags := nb_close_tags + 1; 
nb_other tags := nb_other_tags + 1 

) 

); 

tags :~ tags + str2 

) 

else ( 

if {? %' ?str2 />' ++ ?strl) then ( 

if {str2 :'++?) then ( 

nb_emp_tags nb_emp_tags + 1; 
nb pref ixed_tags := nb_prefixed tags + 1 

) 

else ( 

if (str2 # %' xrce' ++. ?) then { 
nb_emp_tags nb_emp__tags + 1; 
nb_Krce_tags nb_xrce_tags + 1 

else ( 

nb_einp_tags nb_emp_tags + 1; 
nb_other__tags := nb_other_tags + 1 

) 

); 

tags := tags + str2 

) 

) 

) 

) 

else (none) 

); 

print ( 'number of opening_tags +str (nb_open_tags) ) ; 
print ( ' number of closing_tags : ' +str (nb_close_tags) ) ; 
print ( 'number of empty_tags : ' +str {nb_erap_tags) ) ; 
print ( 'number of pref ixed_tags +str (nb_pref ixed_tags) ) ; 
print ( ' number of xrce_tags : ' +str {nb_xrce_tags) ) ; 
print ('number of other_tags +str (nb_other_tags) ) ; 
print (tags) 



[0145] Using if-then-else statements, 3x3 = 9 cases have to be dealt with separately. In languages like C or Java, 
a Switch construct would have produced a more readable solution, but unfortunately, Switch can only be used with 
primary Integer and char/byte types, and test values have to be statically defined. 

[0146] It will be appreciated that the above described technique enables the definition of basic Imperative and de- 
clarative statements, the combination of both kinds of operations in meaningful and arbitrarily complex control struc- 
tures, and the typing of such constructions. 

[0147] Main applications are language construction, refining control abstractions and programmation models toward 
more computational expressiveness, rewriting systems theory, classical conditional term rewriting systems, explicit 
strategies, transformation languages and systems for compilation and language processing, structured document 

transformation, tree pattern matching, event management, explicit or automatic document transfonnation systems, 
and others. 

[0148] The technique provides material for building languages which are less abstract and more general than rewrit- 
ing systems but abstract enough to simplify and extend general purpose programming languages. The technique could 
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hence play an important role in the design of new transformation techniques or the extension of existing ones. Further, 
the technique may solve data and document Interchange problems which will lead to low costs and high quality solu- 
tions. 

[0149] Moreover the technique provides a programming language framework through the definition of generic syn- 
5 tactic constructs, their operational semantics and the associated formal type system. The important difficulties which 
underlie the ambitious goal of bringing together declarative and Imperative programming styles are solved ail together, 

in a conceptuaily new and generic approach. 

[0150] It will be appreciated that the bi-valuation technique enables and complements the symmetrical structural 
pattern matching technique that has been described above, The technique is further particular suited for supporting 

10 general typing mechanisms. Type checking Improves the global reliability of programming languages, and provides 
efficient means for optimization, thus, Increasing the runtime perfonnance. This will be described In more detail below. 
[0151] By means of bi -valuation of programming statements, and by using imperative connectors, the design of new 
programming languages or the extension of existing programming languages are rendered possibie with constructions 
that provide Innovative expressiveness. Resulting languages are located at an Intermediate level of abstraction, be- 

15 tween declarative, functional and Imperative languages. This kind of abstraction could play an Important role in general 
structure transformation technologies. When building modem programming languages with adequate control abstrac- 
tion level, the major difficulty is to find the best trade-off between simplicity and power, conciseness and expressiveness. 
It will therefore be appreciated that the present technique provides programming constructs in such a way that the 
constructs offer compositional capabilities. Further, connectors are provided that allow the composition of such con- 

20 structs with relevant semantics. Further, a sound type system is provided which enables to check out composition errors. 

Statement Evaiuation Syntax and Operational Semantics 

[0152] In the following, the syntax and semantics of the basic conditional and Imperative constructs are described 
25 in more detail. 

[0153] in the testing operation, environment modifications are allowed during evaluation of the boolean part. This 
enables the use of complex operations with effects on context as a condition for the test; 

r I- r I- e. 

3^ -. [if] 

r I" if thene^ else -> r' h if then else 

If true then else -> eg [if1 ] 

35 

If false then eg ®^se -> 63 [if2] 
[0154] The sequencing operator is defined as shown hereafter; 

40 

V \ - e. -> r h Bi -^0 M 

tseq1] / [seq2] 

r I epe2 ~> r I epe2 ^2 

45 [0155] Futher, an assignment operator is provided that finally reduces to a distinguished value "unit". In the prior art, 
similar mechanisms for typing imperative statements exist for integrating Imperative extensions in the functional frame- 
work. However, the result of such an assignment operation x e is just the result of the expression e itself: 



n x:=e^r'l x:=e'i r, x" 1 x := e -> r, x» 1 unit 

[0156] Moreover, an iterative construct is provided in the fomn of aclosure operator, noted *(e), which allows to iterate 
an action e until it evaluates to a distinguished value "none". Thus, this action must be a declarative action, since 
55 applying the closure to a pure imperative action like an assignment would produce endless computation. This property 
is checked by the typing rules described beiow. The semantics of the * operator is simply defined by 

*(e) if (el = none) then *(e) else unit [*J. 
[0157] A closure operation, returning always the distinguished value "unit", is considered as a pure imperative (mono- 
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valuated) statement. 

[0158] Declarative constructs are defined as shown hereafter: 



e ::= e=>e' rule 
l\ei, en\] action system (ordered) 

{ I eu ©/J I } action system (unordered) 



[0159] As mentioned above; the first universal construction is the rule, constituted of a left-hand condition and a 
right-hand action executed only if the condition can be verified. The proposed syntax, and the following type system, 
allows the cascading of rules of the form => =^ e^, understood as ©/ (e^ =^ e^); 

6^=^62 -» if {e-f true) then ^'se none [Rule] 
[0160] In declarative environments, such mles are usually assembled In larger systems. The rule choice and appli- 
cation strategy varies a lot depending on the various proposed models, but most common tactics are "try rules in order" 
or "try and rule" and "iterate application as much as possible". These standard models, and more sophisticated tactics 
as well, are easily emulated by combining the action systems with the closure operator presented above. 
[0161] The ordered action system consists of a succession of actions to be tried In the given order In the following 
definition, v^c denotes a "fresh" variable, i.e with a unique name: 



n>2 Oei,..-,e^{]-4 



if (t?j ncne) 
dsev/ 



[Asysl] 



IW]^€ [Asy82] 



[0162] It Is to be noted that this definiton implies that all actions e-f, e^.^ must be bi-valuated, i.e possibly evaluated 
to "none"; the last one can be mono-valuated. In that case the whole system becomes itself mono-valuated, since a 
value different from "none" will be finally returned. 

[0163] Unordered action systems as similarly defined, up to the (random) choice of action e^ among all others: 



n > 2, i € {1, . . . , n) {|ei, . . . , c„|} -f 



if (»/ s== none) 
dsev/ 



[Asysbl] 



{|e|} e [Asysb2] 



[0164] One consequence of this definition is that here, a!! actions must be bi-valuated, in the sense given above. 
Such an action system specifies permutation equivalent rule collection, allowing great perspectives for run-time opti- 
mizations. Moreover, it allows the programmer to avoid producing over-specified code, making the code more under- 
standable to external code reviewers or maintainers. 

[0165] Turning now to the imperative connectors, the terminology "imperative connector" has been chosen by ref- 
erence to the so-called "Boolean connectors", In order to underline the similarity In both cases, values are bi-valuated. 
But the present, more subtle approach to the valuation domains allows to handle several data sets. 
[0166] The first useful connector Is the well-known sequence ";" already presented. 

[0167] Another useful set of operators are concurrent execution (binary) operators, noted ||^ e^and e-f ||'^ e^, and 
also ej II* 62 for both, equipped with the following interleaving semantics: 
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1 ^ — [Pari] — 1 2 _[ParRi 



r h- ©1 Ir ©2 1^' ^1 r ^2 r Ir r* I-- Ir 

[0168] The first operator ||^. besides its concurrent semantics, behaves like a logical "and", comnnonly noted a, with 
respect to the nr^anagement of the bl-valuation: 

unit 11' ~^ ^2 IP^i'"'^] noJ^® T^z ^2 - ^^^^ [Par1b] 



IP none -> ; none [Paric] Ipunit [Par1d] 



[0169] With the equivalent "or" behavior, commonly noted v, is expressed: 



unit f ©2 unit [Par2a) none || ' eg -> eg [Par2b] 



IP none ^ e^ [Par2c] f unit ^ \ unit[Par2d] 

[0170] This definition describes a simple concurrent semantics, that can be extended to a wider scope. The important 
point here is to define this concurrent composition as a bi-valuated statement consistent with the global framework. 
[0171] Besides concurrent imperative connectorS: there are also provided sequential imperative connectors, Then, 
Else, And and Or. 

[0172] Then and Else are defined by: 

Then 02 -> if(e^Unone) then else none [Then] 
Else ^2 var Vf^e^. if(vp=none) then e^eise v^[Else] 

[0173] V/is a fresh variable, i.e. doesn't occur In the current context nor in or e^. The following And and Or operators 
are quite similar, except that they Impose the evaluation of both operands whatever result Is computed. Another dif- 
ference is that values computed by both operands can only range over {unit none}. In that sense, and are 
imperative expressions; 

e-i And e^ -> if(ejl- none) then e^ else (e^; none) [And] 
ey Or e^ if{ey == none) then e^ else (e^; unit) [Or] 

Type System 

[0174] A minimal, formal, type system that Illustrates and enables the use of the constructs is described hereafter. 
This type system is based on a subtyping relation using inclusion polymorphism brought by a non -discriminating union 
type constructor. An example of a type hierarchy Is shown in FIG. 5, 

[0175] The type system introduces other relevant tools, when required, to known techniques for building type sys- 
tems. It is described through "typing judgments" logically organized by means of "typing equations". 
[0176] The typing judgement y C> e : f states that expression e has type f in the typing context 7. The notion of y > f 
< t' asserts that type f is a sub-type of type f and a more original judgement 7 O e :: f, says that the expression e has 

minimal type t Formally, this last relation is characterized by the following property: 

(Minimal type) y t> e t \n "^t , y t> e : t' =^ y > t ^ t' 

[0177] This notion of minimal type is useful in order to avoid overgeneralized inferences due to the so called sub- 
sumption rule (see [Sub]), while preserving the convenience of subtyping mechanism. The notation x: tt> ... ex- 
presses that the fact that "x is a variable of type f is registered in the typing context. More precisely, y, x : f is a typing 
context y'such that y = y u The following rules define the reflexive and transitive subtyping relation for ail well- 
formed types t, t, ' t^, ?3 and the typing context y: 

y\>t<t [Ref 1] ^ ' / / ^[Trans] 
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~[Min ^ — ^7 ISub 



' !rw|/ ^ r t^^J Xt<t t ^^^^ 



-[U3] 



[0178] Rules for defining wen-formedness conditions on types will not be sliown, and types are supposed well formed 
in ali following definitions. An important type constructor is the non-discriminating union which provides inclusion pol- 
ymorphism, 

[0179] Basic typing of literals and variables Is defined by the following axioms: 

0 l> n :: int [Num] 0D>s :; string [Str] y, x:t >x:: t [Var] 

0 >true :: bool [Booll] 0 l>faise ;: bool [Bool2] 

0 [> none :: None [None] 0 >unit :: Unit [Unit] 



[01 80] Operators are typed by : 



7>ei:ipt 7>e2:fpt 7>ei string 7[>e2:string 

7l>ei*e2-iat 7 > ei + " string 

> Ci 63 " 7 > Ci! = 63 - bOOl 

7>e:bool 7>ci:;ti 7>«3::*2rTia ^^^001(7) 7l>ei:< 7,€i ^2 - ^2 p., , 

J J {itj I varj 

7>ifctheiiei dseea ::ti|<a 7> war=ex.e2 ::<2 



[0181] It is to be noted that [Eq^Neq] do not impose operands to have the same common type. That is, equality 
comparisons are applicable to every kind of data. 
[0182] Other basic constructs can be typed through: 

Y > : UnitlNone yt>e^::t^ yt>x::t 7 t> e : f y > ^ Unit/None 

yl>e,,e2::t^ ^^^"^^ Y>x:=e::Unlt ^^^^^J Y>*(e)::Unit ^^'""^^ 

[0183] Concun'ent connectors are always bl-valuated Imperatives: 

pParAnd] [PtoOr] 
7 1> ei :: UiiU|None 7 > : Unit|Noiie 7 > ei :: Uiiit|Non€ 7 O €2 Unit|None 
7[>ex IP 63 :: UniilNone 7 > ir«2 - Unil|Noiie 

[0184] The following equations achieve very precise type control for "and-like" concurrence: 
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y>e.\ Unit y D> : Unit 

^ ~ = [ParAndl] 



Y > ©1 : None y > ; UnitlNone 

^ ^ — [ParAnd2] 



y > II ©2 ;: None 



[0185] Similarly, for "or-like" concurrence: 

y>e^: None y>eo- None 

-5 — [ParOrl ] 

> f ©2 :: None 

y ■> ^1 : Unit y > e-s : UnrtlNone y > : NonelUnit y l> : Unit 

-- ^ [ParOr2] -- -- -- [ParOrl] 

j> f^e2 Unit > f ©2 

[0186] Sequential connectors are defined by. for some t, t': 

y 1> :: UnitlNone y t> ©2 :: f y>e^ :: fINone y E> eg :: t' 

y > Then flNone ^^^^^ y\>e^ Else ©2 - ^^'^^^ 

y i> e. :: UnitlNone y > ;; UnitlNone y !> ei :: UnitlNone y > :: UnitlNone 

J ] ! 1 [And] ' — ~ [Orl 

y > And ©2 ;: UnitlNone y > Or ©g :: UnitlNone 

[0187] Beyond these last two equations, as for concurrent connectors, much more precise type checking is provided 
In order to detect composition errors; 

yOfiiiiNone y > e« : UnitlNone y > : UnitlNone yI>eo"None 

jri [And1] j—, — [And2] 

y i> And None Y i-^ And eg :: None 

y t> ©4 :: Unit y > :: Unit 

[And3] 

y D> e^ And ©2 Unit 

y > e^ :: Unit y > eg ; UnitlNone [> : UnitlNone y > eg :: Unit 

y > Or :: Unit ^^^^^ y > Or :: Unit ^^^^^ 

y 1> e^ :; None y l> e« :: None 

y D> e.j Or 62 :: None ^ ^ 

[0188] The relevance of the typing approach described above with respect to the semantics of the language con- 
structs described above is now demonstrated in more detail. 

[0189] The soundness property is to prove that a well typed construct cannot produce an error during evaluation. 
More precisely, ft establishes the conservation of the well typed property: any well typed expression remains well typed 
over all possible computation steps. One preliminary step Is to define a logical relation between the typing context and 
the execution environment: 

[0190] The execution environment T is confonn with respect to the typing context y (noted y It- F): 

ylhriffVx^^Er yt>x::f a 0Dn)::f 
[0191] in the following, e is understood as a non-reduced syntactic expression. The type is preserved during reduc- 
tion: 
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Ih r and 7 > e : t 




7 O e' : * 

7frr 



[0192] The proof presents no particular difficulty; it uses an induction on tine structure of e. 
[0193] The connpleteness property states that all derivations, I.e. connputation steps, defined by the operational se- 
mantics is covered by the type control mechanism. Completeness is defined by: 



[0194] As for the preservation of type, the proof presents no particular difficulty; it uses an Induction on the structure 
of e. 

[0195] Using the foregoing specification, the Invention may be Implemented as a machine (or system), process {or 
method), or article of manufacture by using standard programming and/or engineering techniques to produce program- 
ming software, firmware, hardware, or any combination thereof. 

[0196] Any resulting program{s), having computer-readable program code, may be embodied within one or more 
computer-usable media such as memory devices or transmitting devices, thereby mal<ing a computer program product 
or article of manufacture according to the Invention. As such, the temns "article of manufacture" and "computer program 

product" as used herein are intended to encompass a computer program existent (permanently, temporarily, or tran- 
sitorily) on any computer-usable medium such as on any memory device or in any transmitting device. 



1 . A method of operating a computer system for evaluating a programming language statement that includes a first 
and a second sub-statement, the method comprising the steps of: 

evaluating the first sub-statement and detemiming an evaluation success result If the evaluation succeeds or 

a distinguished value if evaluation fails; said distinguished value being a value not included in the range of 
possible evaluation success results of the first sub-statement; 

determining whether the second sub-statement is to be evaluated, and if so, evaluating the second sub-state- 
ment and determining an evaluation success result if evaluation succeeds or said distinguished value If eval- 
uation fails; a range of possible evaluation success results of the second sub-statement not including said 
distinguished value; and 

detennining an evaluation result of the statement depending on at least whether evaluation of the first sub- 
statement succeeds or fails. 

2. The method of claim 1 , wherein the second sub-statement is evaluated if evaluation of the first sub-statement did 
not fail, and the evaluation result of the statement Is determined to be the evaluation success result of the second 
sub-statement If evaluation of the first and the second sub-statements succeeds, and wherein the evaluation result 

of the statement is said distinguished value if evaluation of at least one of the first and second sub-statements fails. 

3. The method of claim 1 . wherein the second sub-statement is evaluated if evaluation of the first sub-statement fails, 
and wherein the evaluation result of the statement Is the evaluation success result of the first sub-statement if 
evaluation of the first sub-statement succeeds; the evaluation result of the statement is the evaluation success 

result of the second sub-statement if evaluation of the first sub-statement fails but evaluation of the second sub- 
statement succeeds; and the evaluation result of the statement is said distinguished value if evaluation of both the 
first and the second sub-statements fails. 



{7 > c : 4 
7 > e' : < 



Ciaims 
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4, The method of claim 1 , wherein the second sub-statement is evaluated concun'ently with the evaluation of the first 
sub-statement, and the evaluation result of the statement is said distinguished vaiue if evaluation of at least one 
of the first and second sub-statements faiis. 

5 5. The method of claim 1 , wherein the second sub-statement is evaluated concurrently with the evaluation of the first 
sub-statement, and the evaluation result of the statement is said distinguished value only if evaluation of both the 
first and the second sub-slatemenls fails. 

6. The method of claim 1 , wherein the second sub-statement is evaluated independently on whether evaluation of 
10 the first sub-statement succeeds, and the evaluation result of the statement Is said distinguished value if evaluation 

of at least one of the first and second sub-statements fails. 

7. The method of claim 1 , wherein the second sub-statement is evaluated independently on whether evaluation of 
the first sub-statement succeeds, and the evaluation result of the statement Is said distinguished value If evaluation 

^5 of both the first and second sub-statements falls, 

8. The method of claim 1 , wherein at least one of the first and second sub-statements Includes a closure loop state- 
ment having an operand indicating that evaluation of the respective sub-statement does not stop before said op- 
erand evaluates to said distinguished value. 

20 

9. The method of claim 1 . wherein at least one of the first or second sub-statements includes a rule statement having 
a first argument and a second argument, the evaluation of the first argument triggering the evaluation of the second 
argument. 

25 10. The method of claim 1 , wherein at least one of theflrst or second sub-statements includes an ordered action system. 

11. The method of claim 1 , wherein at least one of the first or second sub-statements includes an unordered action 
system, 

30 12. The method of claim 1 , wherein one of the first and second sub-statements is a declarative statement and the 

other one of the first and second sub-statements is an imperative statement. 

13. The method of claim 1 , wherein the first and second sub-statements are typed according to a hierarchy of types. 
35 14, The method of claim 1 3, wherein said hierarchy of types includes at least one minimal type, 

15. An article of manufacture for use in a computer system comprising: 

a memory; 

40 

instructions stored in the memory for operating a method for evaluating a programming language statement 
that Includes a first and a second sub-statement, the method comprising the steps of: 

evaluating the first sub-statement and detemnining an evaluation success result If the evaluation succeeds 

45 or a distinguished vaiue if evaluation fails; said distinguished value being a value not included in the range 

of possible evaluation success results of the first sub-statement; 

detemriining whether the second sub-statement Is to be evaluated, and If so, evaluating the second sub- 
statement and detemiining an evaluation success result if evaluation succeeds or said distinguished vaiue 

50 if evaluation fails; a range of possible evaluation success results of the second sub-statement not including 

said distinguished value; and 

detemnining an evaluation result of the statement depending on at least whether evaluation of the first 
sub-statement succeeds or falls. 

55 

16. A system for evaluating a programming language statement and determining an evaluation result of said statement; 
comprising: 
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a memory for storing the statement that includes a first and a second sub-statement, 
a processor for determining the evaluation result of the statement; the evaluation result of the statement de- 
pending on whetlner evaluation of the first and second sub-statements succeeds or fails; the processor being 
capable of evaluating the first sub-statement and determining an evaluation success result if evaluation suc- 
ceeds, or a distinguished value if evaluation talis; the processor being capable of evaluating the second sub- 
statement and determining an evaluation success result If evaluation succeeds, or said distinguished value if 
evaluation fails; said distinguished value being a value not included in the range of possible evaluation success 
results. 
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